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ABSTRACT 


A  collection  of  computer  programs,  documentation,  procedures  and 
data  base  design  criteria  have  been  packaged  for  handling  small  to 
medium-sized  data  bases •  This  first  volume  of  the  series  gives  a  sys¬ 
tem  overview  of  the  resulting  data  base  tools  and  techniques ,  which 
were  developed  largely  in  support  of  the  MACIMS  analysis  effort.  Sub¬ 
sequent  volumes  provide  user  information  for  each  part  of  the  system. 
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SECTION  I 


INTRODUCTION 


The  software  system  and  concepts  described  by  this  series  of 
documents  were  largely  developed  in  support  of  the  MACIMS  project, 
where  data  on  the  MACIMS  system  was  collected,  organized,  and  ana¬ 
lyzed  in  support  of  the  MACIMS  requirements  development.  This  first 
volume  of  the  series  presents  a  system  overview.  Other  volumes  pro¬ 
jected  for  the  series  include: 

Volume  II  -  KFFU  (Keyed  Flat  File  Update) 

Volume  III  -  KFFM  (Keyed  Flat  File  Merge) 

Volume  IV  -  FFRG  (Flat  File  Report  Generator) 

Volume  V  -  FFSP  (Flat  File  Special  Processor) 

Volume  VI  -  UNSTR  (Unformatted  String  Text  Receiver) 
Volume  VII  -  Data  Base  Documentation  Tools 

DS/2,  another  system  associated  with  SDBP,  is  documented  as  PS/2 , 
Users  Manual,  OS  Version,  November  1971,  available  from  the  System 
Development  Corporation,  Santa  Monica,  California. 

Provision  is  made  within  the  Small  Data  Base  Package  for  data 
collection,  generation  and  maintenance  of  data  files,  querying  and 
reporting  of  data,  and  documentation  of  data  elements  and  file 
structures . 
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SECTION  II 


FUNCTIONAL  DISCUSSION 


OVERVIEW 

Figure  1,  Elements  and  Interfaces  of  a  Data  Base  Project,  il¬ 
lustrates  the  major  parts  of  a  data  base  project  and  how  they  inter¬ 
face  with  each  other.  Each  rectangular  a:  ia  of  Figure  1  represents 
a  large  element,  a  common  boundary  between  two  blocks  represents  an 
interfacing  activity,  and  the  relative  size  of  the  boundaries  repre¬ 
sents  the  relative  degrees  of  activity. 

Data  structures  are  kept  simple  for  the  Small  Data  Base  Package. 
Files,  known  as  "flat  files,*'  have  records  which,  for  a  given  file, 
are  the  same  length  and  same  format;  that  is,  data  for  an  item  will 
occupy  the  same  position  in  each  record. 

Data  representation  is  simple  also;  all  data  in  files  is  repre¬ 
sented  in  character  form  with  individual  item  values  limited  to  60 
characters.  While  this  can  cause  some  expansion  of  file  storage  re¬ 
quirements,  it  also  permits  the  use  of  commercially  available  systems 
such  as  DS/2  or  SPSS  for  interactive  querying  or  other  types  of  proces¬ 
sing,  and  encourages  transferability  of  data  bases  between  different 
types  of  computers . 

RAW  DATA  PROCESSING 

Figure  2 ,  Raw  Data  Transformation  Options,  shows  the  flow  of  data 
from  outside  the  system  to  fixed  card  formats.  Three  options  are 
available.  One  option  involves  manual  preparation  of  fixed  format 
cards  directly  from  raw  data.  A  second  option  is  to  keypunch  raw 
data  onto  free  format  cards  and  process  the  cards  with  the  computer 
program  UNSTR  to  automatically  generate  fixed  format  cards.  The 
third  is  to  transfer  the  raw  data  to  paper  tape  (for  example,  by 
ASR35  Teletype) ,  copy  the  paper  tape  to  ASCII  magnetic  tape  with  a 
minicomputer  such  as  D73fs  Interdata  3  computer,  and  then  process 
this  magnetic  tape  with  UNSTR  to  automatically  generate  fixed  format 
cards.  In  all  cases,  the  purpose  is  ultimately  to  transfer  free  for¬ 
mat  raw  data  to  fixed  format  cards  for  further  processing  by  other 
elements  of  the  system.  Data  validation  will  normally  be  done  by 
special  PL/1  programs  designed  for  formats  and  values  peculiar  to 
individual  files. 
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Data  Base  Using  Community 
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Figure  1.  Elements  and  Interfaces  of  a  Data  Base  Project 


Control 
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Figure  2.  Raw  Data  Transformation  Options 


FILE  GENERATION  AND  UPDATE 


Figure  3,  File  Generation  and  Updating,  shows  how  files  are  gen¬ 
erated  and  updated  from  combinations  of  fixed  format  cards  and  files. 
Both  operations  may  be  performed  with  the  update  program,  KFFU. 

Updating  involves  fixed  format  cards,  control  information,  and 
an  input  file.  Updating  includes  deletion  of  individual  data  or 
of  entire  records,  addition  of  individual  data  or  of  entire  records, 
and  modification  of  individual  data. 

For  wholesale  manipulation  of  data,  as  when  an  entire  set  of 
values  for  item  is  to  be  transformed  into  another  set,  the  computer 
program  FFSP  provides  a  framework  into  which  special  subprograms  can 
be  inserted  for  manipulating  the  data. 

FILE  REPORTING 

Figure  4,  File  Reporting  Options,  shows  the  file  reporting  pro¬ 
cess.  Two  processes  are  actually  involved  —  query  reports  and 
standard  reports.  An  online  query  report  capability  is  available 
with  DS/2,  an  SDC  query  package.  Standard  reports  may  be  produced 
with  FFRG. 

DATA  DOCUMENTATION 

Even  modest-sized  data  bases  have  their  problems  with  ensuring 
common  understanding  among  users  of  the  meaning  of  items  and  their 
format  on  cards  and  files.  The  data  base  documentation  package  pro¬ 
vides  for  centralization  of  this  kind  of  information  with  computer¬ 
generated  reports,  based  on  key-punched  descriptions  of  meanings, 
locations,  sizes  and  relationships  of  data  items. 
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Figure  3.  File  Generation  and  Updating 
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Figure  A.  File  Reporting  Options 


SECTION  III 


TECHNICAL  CHARACTERISTICS 


The  data  base  package  was  written  in  PL/1  for  an  IBM  360  or  370. 
Partition  storage  requirements,  which  will  vary  somewhat  between 
applications,  will  not  normally  exceed  128K. 

Control  information  processed  by  members  of  the  package  is  gen¬ 
erally  in  free  format,  data-directed  form  (e.g.,  FRL=60  NCC(5)  *  3). 
A  few  programs  used  fixed  format  control  (card)  inputs. 

When  no  value  is  supplied  or  when  a  supplied  value  is  illegal, 
an  item  will  have  blanks  for  its  current  value. 

Item  values  are  always  character  data,  and  may  not  exceed  60 
characters  in  length. 
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SECTION  IV 


SAMPLE  APPLICATION 


To  illustrate  the  use  of  the  Small  Data  Base  Package,  a  sample 
terminal  network  system  is  described  below. 

The  system  consists  of  three  elements:  terminals,  locations, 
and  links. 

The  data  base  consists  of  three  files:  the  Terminal  Type  File, 
the  Terminal  Unit  File,  and  the  Terminal  Link  File. 

The  Terminal  Type  File  contains  data  which  distinguishes  one 
type  of  terminal  from  another;  the  file  is  described  in  Table  1. 


Table  I 

Terminal  Type  File  Format 


Code 

Start 

Number 

Data  Description 

Name 

Char 

Chars 

Terminal  Type  Code  -  Alphanumerics 
identifying  the  type — e.g.,  33ASR) 

TC 

2 

5 

Terminal  Type  Name  -  (alphanumerics, 
left  adjusted) 

TN 

7 

12 

Terminal  I/O  Device  Description  - 
(alphanumerics,  left  adjusted) 

DD 

19 

27 

Terminal  I/O  Capability  Description  - 
(alphanumerics,  left  adjusted) 

CD 

46 

24 

Number  of  Terminal  Types  -  (digits, 
leading  zero) 

NT 

70 

2 

Transfer  Rate  for  Terminal  -  (digits, 
baud) 

TR 

72 

4 

The  Terminal  Unit  File  contains  data  which  defines  each  terminal; 
the  file  is  described  in  Table  2. 
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Table  II 


Terminal  Unit  File  Format 


Data  Description 


Code  Start  Number 

Name  Char  Chars 


Terminal  Unit  Code  -  (alpha-  UC 
numerics  identifying  the 
unit — e.g.,  3288A) 

Terminal  Type  Code  -  (alpha-  TC 
numerics  identifying  the 
type — e.g.,  33ASR) 

Corporate  Code  -  (alphanume-  CC 
rics  identifying  the  site, 
left  adjusted) 

Building  Number  -  (digits,  BN 

leading  zero) 

Room  Code  -  (alphanumeric —  RC 

e.g.,  1B245) 

Start  Time  Availability  -  (TimeSA 
of  Day  when  terminal  first 
available — e . g . ,  0800) 

End  Time  Availability  -  (Time  EA 
of  Day  after  which  terminal 
not  available — e.g.,  2200) 


2 

7 

12 

27 

29 

33 

37 


5 

5 

15 

2 

4 

4 

4 


The  Terminal  Link  File  contains  data  which  defines  each  line  of 
the  terminal  network;  the  file  is  described  in  Table  3. 

Table  III 

Terminal  Link  File  Format 

Code  Start 

Data  Description  Name  Char 

Link  Code  -  (alphanumeric  iden-  LC  1 

tifier  of  communications  link — 
e.g. ,  LINK1) 

Terminal  Unit  Code  -  (alphanu-  UC  7 

merics  identifying  the  unit — 
e.g.,  3288A) 

I/O  Code  -  (I=input,  0=output)  IC  12 

Transfer  Rate  for  Link  -  (digits, TR  13 

line  rate  baud) 

Certain  code  items  are  used  as  keys  to  relate  data  in  one  file 
with  that  of  another  file.  For  example,  to  find  the  Terminal  Trans¬ 
fer  rate  of  a  unit  described  in  the  Terminal  Unit  File,  the  Terminal 


Number 

Chars 

5 

5 

1 

4 
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Type  Code  value  of  that  entry  is  matched  to  the  Terminal  Type  Code 
value  of  entries  in  the  Terminal  Type  File.  The  transfer  rate 
associated  with  the  matched  code  is  the  correct  rate  for  the  unit 
(e.g.,  unit  5180K  has  the  transfer  rate  of  10  baud). 

Figure  5 ,  Sample  Terminal  Network  Schematic ,  describes  the  sys¬ 
tem  as  a  whole  in  schematic  fashion. 

Figure  6,  Terminal  Network  Files,  describes  sample  versions  of 
the  three  files. 

Tables  4-6  describe  fixed-format  card  formats  for  all  three 
files;  Figure  7  lists  cards  which  would  produce  the  files  of 
Figure  6. 


Table  IV 

Terminal  Fixed-Format  Card  Formats 


Card  Type  A 


Item 

Code 


Start 

Col 


Number 

Cols 


Comments 


- 

2 

2 

Contains  TU  to  identify  file 

- 

4 

1 

Contains  A  to  identify  card  type 

TC 

6 

5 

Terminal  Type  Code 

TN 

11 

12 

Terminal  Type  Name 

DD 

23 

27 

Terminal  I/O  Device  Description 
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Table  IV  (Continued) 


Item 

Code 


TC 

CD 

NT 

TR 


Item 

Code 


UC 

CC 

BN 

RC 

SA 

EA 


Card  Type  B 
Start  Number 

Col  Cols  Comments 

2  2  Contains  TL  to  identify  file 

4  1  Contains  B  to  identify  card  type 

6  5  Terminal  Type  Code 

11  24  Terminal  I/O  Capability  Description 

35  2  Number  of  Terminal  Types 

37  4  Transfer  Rate  for  Terminal 


Table  V 

Terminal  Unit  Fixed-Format  Card  Format 


Start 

Col 

2 

4 

6 

11 

26 

28 

32 

36 


Number 

Cols 

2 

1 

5 

15 

2 

4 

4 

4 


Comments 

Contains  TU  to  identify  file 
Contains  A  to  identify  card  type 
Terminal  Unit  Code 
Corporate  Code 
Building  Number 
Room  Code 

Start  Time  Availability 
End  Time  Availability 
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Figure  5.  Sample  Terminal  Network  Schematic 


13 


Data:  j533ASRTELETYPEj5MjSPAPERj5TAPEt$FUNCHtf&tfREADERtf^UTOMATICl5SEND-RECEIVERj503  0010 


m 

r— I 

o 

CM 

CM 

CM 

•50 

■50 

■*=L 

w 

> 

M 

W 

O 


Q 

-u 


pci 

PH 

*50 

W 

O 

<  Q 

PhH — Q 

pci 

w 


pci 

Ph 

W 

Ej 

c/3 

m 
co  - 
*50 


-H 


U 

H 


E 

<y 


Sw  Pq  w  w 

od  pd  od  pd 


o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

<r 

<r 

vf 

vf 

<f  < 

CM 

CM 

CM 

CM 

CM  H —  rx] 

o 

O 

O 

O 

o 

o 

o 

o 

o 

o 

r^ 

< 

O 

o 

o 

o 

O  H —  CO 

vf 

rH 

oo 

CM 

o 

rH 

rH 

Ov 

W 

pq 

pq 

PQ 

pq  o 

<y 

<y 

on 

rH 

<t 

HH-Pi 

t-H 

tH 

CM 

co 

t-H 

t-H 

CO  _ g 

•H 

*H 

o 

o 

o 

O 

pH 

pH 

■50 

*50. 

*50 

*50 

■50 

*50 

*50 

*50 

•50 

•50 

4J 

*H 

§ 

§ 

§ 

§ 

S 

•H 

e 

O 

o 

o 

o 

o 

|J 

p 

pH 

Cm 

pH 

pH 

pH 

Q 

Q 

Q 

Q 

Q 

t-H 

t-H 

W 

W 

W 

W 

W 

CO 

CO 

pq 

pq 

pq 

pq 

pq 

c 

o 

o 

O 

O 

o 

o 

O 

O 

<r 

00 

00 

<r  pci 

CM 

t-H 

rH 

CMH —  H 

O 

o 

o 

h— M - 

* 

ON 

2 

2 

* 

O 

r^. 

00 

00 

t-H 

CM 

CM 

t-H  u 

m 

CO 

CO 

inn — P 

o 

M 

M 

M 

M  U 

hJ 

rJ 

.JH-  hJ 

•50 

•50 

•5O 

**a 

o 


cO 

Q 


E 

<y 


H 

H 

H 

H 

H 

<y 

M 

M 

H 

M 

H  O 

H 

§ 

§ 

§ 

§ 

g  H — U 

C/3 

< 

C/3 

< 

C/3 

< 

3 

3 

CO 

CO 

co 

m 

m  o 

CO 

< 

CO 

< 

co 

< 

3 

3^H 

•*a 

00 

00 

<T 

ON 

o 

00 

ON 

00 

o 

O 

O 

O 

rQ 

CM 

CM 

m 

t-H 

rH  U 

o 

o 

o 

O 

co 

co 

co 

m 

mn-io 

00 

00 

00 

oo  pci 

•o 

*50 

•50 

*50. 

*50 

*50 

t-H 

t-H 

rH 

HH-  H 

U 

<y 

M 

M 

o 

MH - 

-  M 

4J 

mm 

< 

vt 

< 

00 

2 

2 

C 

<y 

CO 

E 

ON 

00 

00 

co 

4J 

cy 

m 

CM 

CM 

CM  O 

<y 

CO 

■u 

co 

CO 

CO 

CO  H —  |3 

Pi 

Q 

M 

pq 

pQ 

O 

ci¬ 

ty 

S 

s 

U 

M 

M 

M 

M  U 

.J 

<y 

■5O 

50 

•50 

•50 

u 

CO 

Q 


E 

(1) 


CO 

C 

CO 


o 

53 


14 


Figure  6,  Terminal  Network  Files 


Table  VI 


Terminal  Link  Fixed-Format  Card  Format 


Item 

Code 

Start 

Col 

Number 

Cols 

Comments 

- 

2 

2 

Contains  TL  to  identify  file 

- 

4 

1 

Contains  A  to  identify  card 

LC 

6 

5 

Link  Code 

UC 

11 

5 

Terminal  Unit  Code 

IC 

16 

1 

I/O  Code  (I  or  0) 

TR 

17 

4 

Transfer  Rate  of  Link  (Band) 

Using  KFFU,  the  files  described  above  can  be  generated  from  the 
fixed-format  cards  also  described  above.  Reports  can  be  generated 
with  FFRG  directly  from  these  files  or  from  merged  temporary  files 
generated  with  KFFM.  All  the  control  information  needed  by  these 
programs  is  given  in  the  above  tables;  the  only  data  which  appears 
in  more  than  one  file  is  key  (code)  data  to  permit  cross-referencing. 
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APPENDIX 


DEFINITIONS  AND  DISCUSSIONS  OF  TERMS 


INTRODUCTION 

This  material  serves  two  purposes.  The  first  is  to  define  what 
is  meant  by  certain  frequently-used  terms  in  the  context  of  the  Small 
Data  Base  Package.  The  second  is  to  present  additional  material  on 
the  concepts  upon  which  the  design  and  use  of  the  Small  Data  Base 
Package  is  based.  The  definitions  are  ordered  alphabetically  to  per¬ 
mit  easy  access  for  the  first  purpose;  to  use  this  material  for  under¬ 
standing  design  and  use  concepts,  however,  the  following  reading  order 
is  recommended: 

Software 

Hardware 

Data 

Data  Base 
File 

Flat  File 

Keyed  Flat  File 

Element 

Entry 

Record 

Attribute 

Item 

Fixed  Format  Cards 

DEFINITIONS 

Attributes  Abstract  features  of  elements  for  which  values  can 

be  determined  and  assigned  to  items  as  data.  Items 
are  the  concrete  (i.e.,  data  base)  equivalent  of 
attributes.  If,  for  example,  terminals  were  an 
element  of  a  transportation  data  base  such  as  MACIMS 1 , 
attributes  could  include  character  rate,  model  number, 
and  type  of  display  (CRT,  printed  paper,  punched 
paper,  etc.).  These  are  all  features  of  terminals 
which  would  have  only  one  value  for  any  one  terminal. 
Some  attributes  may  have  more  than  one  value,  such 
as  terminal  location  and  terminal  number.  When  the 
range  of  values  is  large  enough  (a  decision  by  the 
data  base  designer) ,  a  separate  file  will  be  estab¬ 
lished.  In  this  case,  one  file  could  be  a  Terminal 
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Characteristics  file  and  the  other  a  straight  Term¬ 
inal  file;  the  two  files  would  contain  the  model 
number  of  the  terminal  as  an  attribute ,  which  could 
then  be  used  as  a  key  to  associate  data  between  the 
two  files. 

Data 

The  values  assigned  items  in  a  data  base.  All  blanks 
in  a  value  indicates  that  the  item  has  yet  to  be 
assigned  a  meaningful  value. 

Data  Base 

Data,  in  machine-accessible  form  (punched  cards, 
magnetic  tape,  disc,  etc.),  organized  as  one  or  more 
files.  The  data  may  come  from  external  sources 
(people,  books,  other  data  bases,  etc.)  or  may  be 
generated  from  other  data  in  the  same  data  base. 

Element 

An  abstraction  of  the  data  base  at  the  lowest  level 
which  is  defined  by  one  or  more  attributes .  For  ex¬ 
ample  ,  people  could  be  an  element  of  a  data  base , 
with  attributes  such  as  height,  weight,  employee 
number,  work  category,  and  telephone  number. 

Entry 

The  collection  of  item  values  in  a  file  which,  taken 
together,  define  one  of  the  file's  elements  (e.g., 

George  Washington  as  distinct  from  Abraham  Lincoln 
in  a  Presidential  file) . 

FFRG 

Flat  File  Report  Generator,  the  part  of  the  SDBP 
which  provides  for  writing  reports  from  flat  files. 

FFSP 

Flat  File  Special  Processor,  the  part  of  the  SDBP 
which  provides  for  special  processing  of  flat  files 
which  would  be  difficult  for  KFFU  (e.g.,  mass  con¬ 
version  of  an  item's  values) . 

File 

A  subset  of  a  data  base  which  has  been  made  on  the 
basis  of  relationships  between  items  of  the  data  base. 

In  the  approach  used  with  the  Small  Data  Base  Package , 
a  file  is  organized  around  an  element  of  the  data  base 
(such  as  a  Personnel  Characteristics  File  around 
people  data) .  The  data  in  a  file  represents  values 
for  attributes  of  the  element  (like  a  person's 
height)  which  have  one  value  (or  at  most  a  very  few 
values,  which  would  then  be  assigned  separate  names 
like  PH0NE1,  PH0NE2)  for  any  one  element.  For  ex¬ 
ample,  children's  names  in  a  Personnel  data  base  would 
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probably  be  broken  off  into  a  separate  file  along 
with  their  individual  attributes  (such  as  birth  date) 
and  a  key,  which  is  an  attribute  to  associate  data 
from  one  file  to  another.  In  the  case  of  a  Children’s 
File,  the  key  might  be  the  parent’s  employee  number, 
which  would  also  appear  in  the  Personal  Character¬ 
istics  file  entry  for  the  parent. 

Fixed  Format 
Cards 

The  standard  data  source  (but  not  necessarily  the 
only  one)  from  which  files  are  directly  generated  or 
updated.  Fixed  Format  Cards  have  column  1  blank, 
columns  2-3  reserved  for  the  file  code  (e,g.,  PC 
for  Personal  Characteristics) ,  column  4  reserved 
for  the  card  type,  and  column  5  blank.  Column  6  is 
reserved  for  the  start  of  the  key  data,  which  is 
repeated  for  every  card  type  containing  data  for  the 
same  element.  After  the  key  data  come  attribute 
data,  usually  arranged  so  as  to  fit  the  greatest 
number  of  items  on  the  fewest  card  types  (an  item 
cannot  be  continued  across  card  types) .  The  use 
of  more  than  one  card  type  becomes  necessary  when 
the  net  length  of  the  items  associated  with  elements 
of  a  file  exceeds  the  room  available  for  data  on  a 
card  (75  columns  including  the  key  item) . 

Flat  File 

A  file  in  which  every  entry  has  the  same  items  (same 
size,  same  meaning,  same  relative  position  in  the 
record,  but  not  usually  the  same  values)  as  every 
other  entry.  In  the  Small  Data  Base  Package  design 
approach,  the  first  character  of  every  record  is 
reserved  as  a  flag  to  indicate  data  which  was  new 
or  changed  when  the  file  was  last  updated  or  gen¬ 
erated. 

Keyed  Flat  File 

A  flat  file  which  has  at  least  one  piece  of  data 
(like  an  employee  number)  which  can  be  used  to  relate 
to  data  in  another  keyed  flat  file  (like  a  Children’s 
File) .  The  entries  of  a  keyed  flat  file  are  sorted 
by  key  values.  The  key  item  will  normally  start  in 
the  second  character  of  a  file  record  and  be  fol¬ 
lowed  by  data. 

KFFM 

Keyed  Flat  File  Merge,  the  part  of  the  SDBP  which 
provides  for  merging  portions  of  two  keyed  flat  files 
based  on  common  key  values. 

19 


KFFU 

Keyed  Flat  File  Update,  the  part  of  the  SDBP  which 
provides  for  updating  (including  generating  and 
maintaining)  keyed  flat  files. 

Hardware 

Equipment  (such  as  computers ,  tapes ,  and  disks) 
which  support  the  operation  of  computer  programs. 

Item 

The  concrete  equivalent  of  attributes.  Items  are 
assigned  names  (e.g.,  EMPNO)  and  standard  sizes 
(e.g.,  35  characters).  For  each  file  in  which  the 
item  appears,  the  item  will  also  have  a  starting 
position  in  the  file  (e.g.,  character  15);  usually 
the  size  of  the  item  in  the  file  will  be  the  same 
as  the  standard  size.  The  item  will  normally  also 
have  a  card  type  assignment  (see  Fixed  Format  Cards) 
and  a  card  starting  column  for  each  file;  the  ex¬ 
ception  to  this  is  the  item  which  is  generated  from 
data  in  the  same  or  other  files. 

Record 

The  hardware  representation  of  Entry.  A  record  is 
the  collection  of  data  associated  with  an  element 
involved  In  each  read  or  write  operation  directed 
to  a  file. 

SDBP 

The  Small  Data  Base  Package ,  a  system  of  concepts  , 
procedures  and  programs  oriented  towards  the  manage¬ 
ment  of  small-  to  medimum-sized  data  bases. 

Software 

Computer  programs  ,  as  well  as  documentation  of  com¬ 
puter  programs  and  of  data. 
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